Loading...

Measuring data performance

by Guest Contributor 2 min read January 20, 2010

Meat and potatoes
Data are the meat and potatoes of fraud detection. You can have the brightest and most capable statistical modeling team in the world. But if they have crappy data, they will build crappy models. Fraud prevention models, predictive scores, and decisioning strategies in general are only as good as the data upon which they are built.

How do you measure data performance?
If a key part of my fraud risk strategy deals with the ability to match a name with an address, for example, then I am going to be interested in overall coverage and match rate statistics. I will want to know basic metrics like how many records I have in my database with name and address populated. And how many addresses do I typically have for consumers? Just one, or many? I will want to know how often, on average, we are able to match a name with an address. It doesn’t do much good to tell you your name and address don’t match when, in reality, they do.

With any fraud product, I will definitely want to know how often we can locate the consumer in the first place. If you send me a name, address, and social security number, what is the likelihood that I will be able to find that particular consumer in my database? This process of finding a consumer based on certain input data (such as name and address) is called pinning. If you have incomplete or stale data, your pin rate will undoubtedly suffer. And my fraud tool isn’t much good if I don’t recognize many of the people you are sending me.

Data need to be fresh. Old and out-of-date information will hurt your strategies, often punishing good consumers. Let’s say I moved one year ago, but your address dataare two-years old, what are the chances that you are going to be able to match my name and address? Stale dataare yucky.

Quality Data = WIN
It is all too easy to focus on the more sexy aspects of fraud detection (such as predictive scoring, out of wallet questions, red flag rules, etc.) while ignoring the foundation upon which all of these strategies are built.

Related Posts

Lending hasn’t slowed down—but many decisioning processes have. Applications are coming in faster. Fraud is becoming more sophisticated. Borrowers expect near-instant responses. And yet, inside many organizations, decisions are still being made across fragmented systems, manual reviews, and rigid strategies that weren’t designed and aren’t optimized for today’s environment. That broadening gap isn’t just an operational issue but often stems from a lack of innovation as well. And it’s quietly costing lenders growth, efficiency, and competitive position. When decisioning falls behind, some symptoms are easy to recognize, like applications taking days to process, teams overloaded with manual reviews, and credit and fraud decisions happening in separate platforms. Others are not as obvious, but arguably more impactful, slipping bottom lines and fraud and therefore losses lurking in lenders’ portfolios. The root issue is a fragmented infrastructure. Experian has reported that while 79% of financial institutions surveyed globally want fewer vendors or more unified approaches, they typically use eight or more tools across credit, fraud and compliance. As most decisioning environments cannot integrate data, adapt strategies, and execute decisions in real time, lenders often have to make tradeoffs. Speed vs. accuracy; growth vs. risk; and automation vs. control are just some. Meanwhile, the market has moved on. Leading lenders are no longer optimizing individual steps. They’re rethinking decisioning as a connected, intelligent system. Gaps forming from status quo in 8 key decision areas Across the lending lifecycle, there are eight critical moments where decisioning can either accelerate growth or create friction. Pre-qualification: Pre-qualification should expand your funnel with confidence. But limited data access and static criteria often result in overly conservative targeting or missed opportunities. Additionally, the delay in acting on a pre-qualification funnel highlights a key area for opportunity among many lenders. Instant credit decisions: Customers expect real-time outcomes. When decisions rely on manual intervention or fragmented inputs, speed and conversions suffer. Prescreen and targeting: Disconnected data and rigid segmentation can lead to poorly aligned offers, reducing response rates and wasting acquisition spend. Credit line management: Without dynamic strategies, credit lines may be too restrictive (limiting growth) or too aggressive (increasing risk). Early delinquency management: Missed early signals and delayed interventions make it harder to prevent accounts from deteriorating. Mid- and late-stage delinquency: Strategies that don’t adapt to evolving borrower behavior reduce recovery effectiveness and increase losses. Collections and recovery: Manual, one-size-fits-all approaches limit recovery rates and increase operational cost. Ongoing strategy optimization: Perhaps the most overlooked gap: many lenders lack the ability to continuously test, learn, and refine decision strategies as conditions change. What these gaps are really costing you Individually, each of these breakdowns may seem manageable. Together, they can create systemic drag on performance. That shows up in four critical ways: Missed growth opportunities: Good borrowers are declined, abandoned, or never targeted in the first place. Credit offers fail to align with actual borrower potential. Higher operational costs: Manual reviews and disconnected workflows consume time and resources that could be spent on higher-value work. Increased fraud exposure and friction: Fraud is proliferating and becoming more expensive to manage. The Federal Trade Commission reported $12.5B were lost to fraud in the U.S. in 2024, a 25% increase over the prior year. For many financial institutions, the first reaction is often to add more steps to the decisioning process, which can impact good borrowers. Increased competitive pressure: Fintechs and modern lenders are focused on delivering faster, more personalized experiences, capturing share while traditional processes lag behind. 80% of banks and credit unions plan to increase their technology spending in 2026, yet many continue to fall short on planned system deployments, according to Cornerstone Advisors’ annual “What’s Going On in Banking” research report. What innovative decisioning leaders are doing differently Leading lenders are changing how decisions are made, creating a competitive advantage. Instead of stitching together point solutions, they’re adopting a more integrated approach that brings together: Comprehensive data – including both credit and fraud insights Optimized decision strategies – designed to balance growth and risk Real-time execution – enabling faster, more consistent outcomes Continuous optimization – adapting to changing market conditions Strategic partnerships – leveraging third-party industry expertise to augment their own This shift eliminates the need for tradeoffs and instead allows lenders to increase approvals while maintaining control, reducing manual effort while improving consistency, and responding faster without sacrificing confidence. The stakes are high and the competition for consumers is even higher, particularly against a backdrop of ever-evolving fraud risks, continuously increasing consumer expectations for seamless, digital-first experiences and often limited resources. Nearly half of banks and 59% of credit unions have already deployed generative AI, with more investing now, according to the Cornerstone Advisors’ report. Closing the innovation gap requires a more fundamental shift toward decisioning systems that are connected, scalable, and built for continuous change. A new foundation for decisioning This is where platforms like Experian Decisioning are changing the landscape. By bringing together credit and fraud insights, decision strategies, and a flexible technology architecture, lenders can move beyond fragmented processes and build a more unified, intelligent decisioning approach. One that fits within existing systems but also evolves with your needs. Where to start Impactful change doesn’t need to be an overhaul of everything at once for most organizations. The first step is understanding where your biggest gaps exist, and which decision areas are creating the most friction or missed opportunity. Once you can see where decisioning is not optimized, you can begin to redesign it in a way that’s faster and more adept for what lending has become. By making better decisions, faster, and with greater confidence, lenders can process applications more efficiently and also break away from the pack by leveraging decisioning as a strategic advantage. Learn more

by Stefani Wendel 2 min read March 26, 2026

A new reality for screening providers Everything about the candidate checked out. Their resume reflected the right experience. Their references confirmed it. The background screening process came back clean. From outside, there was no reason to hesitate. So, the company didn’t.  But within weeks, small inconsistencies began to surface. The employee struggled in ways that didn’t match their credentials. Follow-up questions led to vague answers. Eventually, a deeper review uncovered the issue; this wasn’t just a case of exaggeration. It was candidate fraud. And increasingly, it’s not just individuals acting alone.  In a widely reported scheme, foreign operatives posed as legitimate remote IT workers, using stolen identities and AI-assisted interviews to secure jobs at major Fortune 500 companies. Once hired, access was handed off, allowing bad actors to infiltrate corporate systems and generate millions in illicit revenue. In one case, a single individual funneled over $17 million to a foreign operation. These weren’t obvious scams. The candidates passed interviews. They cleared checks. And that’s exactly the point. For background screening and verification providers, this shift presents both a challenge and an opportunity. As candidate fraud becomes more sophisticated, your clients are no longer just looking to verify records – they’re looking to trust identity itself, and they’re looking to you to help them do it. The assumption that no longer holds For decades, hiring has relied on a simple premise: verify the records, resume, and you can trust the candidate. That model worked when identity was easier to validate in person. But in today’s digital-first hiring environment, identity can oftentimes be asserted, not proven. At the same time, identity-based fraud is accelerating. Synthetic identity fraud alone accounts for billions in annual losses, and employers are increasingly encountering candidates whose identities are far more difficult to validate than their resumes. This creates a critical disconnect: Organizations are still verifying records, but those records may be tied to identities that were never legitimate to begin with. Increasingly, they’re turning to their screening partners to close that gap. The reality of candidate fraud 31% of employers have interviewed candidates using a false identity Only 19% feel confident they can detect fraud in hiring 1 in 4 companies report losses of$50K+from fraudulent hires Why candidate fraud is getting harder to see The nature of candidate fraud has fundamentally changed. At one end of the spectrum, companies are still dealing with candidates who falsify resumes, costing businesses time and money when the truth comes to light later. But at the other end, the threat has escalated dramatically. Coordinated fraud rings are now using stolen identities and AI-assisted interviews to place individuals into remote roles, sometimes without ever revealing their identity. And this isn’t slowing down. According to Gartner, by 2028, 1 in 4 candidates could be fake, driven by AI, remote hiring, and identity manipulation. For screening providers, this introduces a new level of complexity. The challenge is no longer just delivering verified records; it’s helping clients surface risks that traditional screening processes were not designed to identify. What traditional screening still gets right None of this diminishes the importance of pre-employment screening. Verifying employment history, education, and background remains a critical part of responsible hiring, and it should. But even the most thorough screening process is designed to answer a specific question: Do the records align with the identity provided? What it does not answer is the question that matters most now: Is that identity real? That gap between record verification and identity validation is where modern fraud operates. And it represents an opportunity for screeners to expand their role from record validation to helping enable stronger identity confidence. The cost of believing everything is working When fraud moves through the hiring process undetected, the consequences aren’t always immediate, but they can be significant. There are financial risks, compliance exposure and potential access to sensitive systems. But there’s also a more subtle —and often overlooked — impact: The assumption that existing processes are working as intended. When fraudulent candidates pass through screening, it reinforces confidence in processes that may not be equipped for today’s threat landscape. Over time, that false sense of security can become a vulnerability. From screening provider to strategic partner As hiring evolves, so do expectations. Employers are no longer just looking for faster background checks - they’re looking for greater confidence in who they’re hiring. This shift creates an opportunity for screening providers to move upstream in the hiring process. By introducing identity verification earlier in the workflow, providers can help clients detect candidate fraud sooner, reduce downstream risk, and strengthen the integrity of hiring decisions.  More importantly, it allows providers to differentiate their offerings in an increasingly competitive market, shifting from a transactional service to a more strategic capability. A shift in thinking: Identity before everything else To address modern candidate fraud, organizations don’t just need better tools; they need a different starting point. Instead of beginning with records, leading providers are beginning with identity. They are asking a more fundamental question earlier in the process:  Is this person who they say they are? Is this person a real, consistent and verifiable person? When that foundation is established, everything that follows becomes more meaningful. Background checks become more reliable. Verification becomes more consistent. And the ability to detect candidate fraud improves, not because the process is longer, but because it’s more informed. In this model, identifying potential fraud becomes proactive rather than reactive. Why identity verification matters more now than ever The shift to remote and digital hiring hasn’t just changed how companies hire – it’s changed how fraud occurs. Today, a significant portion of fraudulent activity targets the employment process, making it a key point of exposure for identity misuse. In fact, 45% of all false document submissions now occur in the employment sector. In many cases, candidates who falsify information still progress through hiring workflows. A study revealed that 70% of candidates who falsify information still get hired. This reinforces today’s reality: Fraud is no longer slipping through the cracks; it’s moving through the front door. How Experian helps close the identity gap Experian® helps background screeners and verification providers bridge the gap between who a candidate claims to be and who they are. By combining identity verification, fraud detection, and verification solutions, Experian enables providers to enhance their existing solutions – without disrupting their workflows. This allows you to extend your value beyond traditional screening, help clients detect candidate fraud earlier, and strengthen confidence in hiring outcomes.   The result is not just better screening, it’s a stronger strategic position in your clients’ hiring ecosystem, one that reduces risk while improving speed and confidence. Candidate fraud isn’t an edge case anymore. It reflects a broader shift in how identity works in a digital world. And while traditional screening remains essential, it may not be sufficient on its own. Because if identity is uncertain, every subsequent check is built on unstable ground. But when identity is established earlier in the process, everything that follows becomes more dependable. Don’t just verify the candidate records, verify the identityLearn how Experian helps screening providers embed identity verification at the start of the hiring journey to help detect candidate fraud earlier, reduce risk, and strengthen screening outcomes.  Explore Experian’s Fraud Prevention Playbook for Pre-Employment Screening FAQs

by Kim Le 2 min read March 26, 2026

Fraud is evolving faster than ever, driven by digitalization, real-time payments and increasingly sophisticated scams. For Warren Jones and his team at Santander Bank, staying ahead requires more than tools. It requires the right partner. The partnership with Santander Bank began nearly a decade ago, during a period of rapid change in the fraud and banking landscape. Since then, the relationship has grown into a long-term collaboration focused on continuous improvement and innovation. Experian products helped Santander address one of its most pressing operational challenges: a high-volume manual review queue for new account applications. While the vast majority of alerts in the queue were fraudulent and ultimately declined, a small percentage represented legitimate customers whose account openings were delayed. This created inefficiencies for staff and a poor first impression of genuine applicants. We worked alongside Santander to tackle this challenge head-on, transforming how applications were reviewed, how fraud was detected and how legitimate customers were approved. In addition to fraud prevention, implementing Experian's Ascend PlatformTM, with its intuitive user experience and robust data environment, has unlocked additional value across the organization. The platform supports multiple use cases, enabling collaboration between fraud and marketing teams to align strategies based on actionable insights. Learn more about our Ascend Platform

by Zohreen Ismail 2 min read February 18, 2026